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In the claims: 

1 . (currently amended) A video-based animal behavior analysis system, comprising: 
a computer configured to determine a position and shape of an animal from video 

images and to characterize activity of said animal as one of a set of 
predetermined behaviors based on an analysis of changes in said position and 
said shape over time. 

2. (original) The system of claim 1 , fiirther comprising: 

a video camera and a video digitization unit coupled to said computer for capturing 
said video images and converting said video images from analog to digital 
format. 

3. (original) The system of claim 2, further comprising: 

an animal identification, segregation, and tracking module receiving said video 
images. 

4. (original) The system of claim 3, wherein said computer further includes a behavior 
identification module for characterizing activity of said animal, said behavior identification 
module being coupled to said animal identification, segregation, and tracking module. 

5. (original) The system of claim 4, wherein said computer further includes a standard 
animal behavior storage module that stores information about known behavior of a 
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predetermined standard animal for comparing the activity of said animal, said standard 
animal behavior storage module being coupled to said behavior identification module. 

6. (original) The system of claim 1, wherein said animal is a mouse. 

7. (original) The system of claim 1 , wherein said animal is a lat. 

8. (currently amended) A method of determining and characterizing activity of an 
animal using computer processing of video images, comprising the steps of: 

detecting an animal in said video images; 

tracking changes te in position and shape of said animal over a plurality of said video 
images; 

id e ntifying and classifying said changes te in position and shape of said animal as 
postures; and 

characterizing said activity of said animal as one of a set of predetermined behaviors 
based on a comparison of a sequence of said postures to pre-trained models or 
rules of said set of predetermined behaviors such activity . 

9. (currently amended) The method of claim 8, wherein said step of characterizing said 
activity includes the steps of: 

describing a said sequence of said postures as behavior primitives; and 
aggregating said behavior primitives into actual behavior over a range of imagest^ 
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10. (currently amended) The method of claim 9, wherein said step of characterizing said 
activity by d e scribing and aggr e gating b e havior primitiv e s further includes the steps of: 
describing a set of conditions and rules required for characterizing said activitv 
activiti e s ; and 

matching and testing generated features to see if said condition and rules are 
satisfiedf^ 



11. (currently amended) Th e m e thod of claim 8 > wh e r e in said detecting an animal 
includ e s using a background subtraction method comprising the st e ps of: A method of ^ 
determining and characterizing activitv of an animal using computer processing of video 
images, comprising the steps of: 

detecting an animal in said video images: 

tracking changes to said animal over a pluralitv of video images: 

identifying and classifying said changes to said animal: and 

characterizing said activitv of said animal based on a comparison to pre-trained 

models or rules of such activitv. wherein the step of detecting an animal in 
said video images includes 

apply ing a lenient threshold on a difference between a current image and a 
background so as to determine a broad region of interest; 

classif ying by intensity values various pixels in said region of interest to 

obtain said animal, by selecting only those intensity values that belong 
to a ti» set of model intensity values of said A© animal; and 

refin eing contours of said animal image by smoothing. 
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12. (currently amended) The method of claim 8 40, wherein said step of classifying said 
changes in position and shape of said animal as postures poGturo d e torminatioH -afid 
dosoription includes using statistical and contour-based shape information. 

13. (currently amended) The m e thod of claim 12, wh e r e in said st e p of id e ntifying and 
cla s sifying changes to said animal includ e s using statistical shape information s e l e ct e d from 
the group consisting of: A method of determining and characterizing activity of an animal 
using computer processing of yideo images, comprising the steps of: 

detecting an animal in said yideo images; 

tracking changes to said animal oyer a plurality of yideo images: 

identifying and classifying said changes to said animal: and 

characterizing said activity of said animal based on a comparison to pre-trained 

models or rules of such activity, 
wherein said step of characterizing said activity includes the steps of: 
describing a sequence of postures as behavior primitives: 
aggregating behavior primitives into actual behavior over a range of images: 
describing a set of conditions and rules required for characterizing said activities: and 
matching and testing generated features to see if said conditions and rules are 

satisfied: 

wherein said posture determination and description includes using statistical and contour- 
based shape information: 

wherein said step of identifying and classifying changes to said animal includes using 
statistical shape information selected from the group consisting of: 
area of said ^ animal; 
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centroid position of said animal; 

bounding box and aspect ratio of said bounding box of said fee aniinal; 
eccentricity of said fee animal; and 

directional orientation of said fee animal relative to an axis as generated with a 
Principal Component Analysis. 

14. (currently amended) The method of claim 12, wherein said step of id e ntifying and 
classifying said changes in position and shape of said animal as postures ohang e o to said 
animal uses contour-based shape information selected from the group consisting of curvature 
measures, thickness measures, relative orientation measures, length measures, and comer 
points. 

15. (currently amended) The method of claim 12, wherein said step of id e ntifying and 
classifying said changes in position and shape of said animal as postures changes to said 
animal includes identifying a set of model postures and feeif description information for said 
set of model postures^ said set of model postures including a horizontal side view posture, a 
vertical posture, a cuddled posture, a horizontal front/back view posture, a partially reared 
posture, a stretched posture, a hang vertical posture, a hang cuddled posture, an eating 
posture, and a drinking posture. 

16. (currently amended) The method of claim 12 44, wherein said step of identifying and 
classifying said changes in position and shape of said animal as postures chang e s to said 
animal includes classifying the statistical and contour-based shape information from a current 
image to assign a best-matched posture. 
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17. (currently amended) The method of claim 9 40, wherein the said step of describing 
said sequence of said postures as said behavior primitives includes the st e p of identifying 
patterns of postures over a sequence of images. 

18. (currently amended) The m e thod of claim 17, A method of determining and 
characterizing activity of an animal using computer processing of video images, comprising 
the steps of: 

detecting an animal in said video images: 

tracking changes to said animal over a plurality of video images: 

identifying and classifying said changes to said animal; and 

characterizing said activity of said animal based on a comparison to pre-trained 

models or rules of such activity, 
wherein said step of characterizing said activity includes the steps of: 
describing a sequence of postures as behavior primitives: 
aggregating behavior primitives into actual behavior over a range of images: 
describing a set of conditions and rules required for characterizing said activities: and 
matching and testing generated features to see if said conditions and rules are 

satisfied: 

wherein the said step of describing said behavior primitives includes the step of identif/ing 
pattems of postures over a sequence of images: and 

wherein said step of describing said behavior primitives step further includes the step of 
analyzing temporal information selected from the group consisting of direction and 
magnitude of movement of the centroid, increase and decrease of the eccentricity, increase 
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and decrease of the area, increase and decrease of the aspect ratio of a ^ bounding box, and 
change in contour information. 

19. (currently amended) The method of claim 10, wherein the said step of d e t e rmining 
actual b e havior by aggregating said behavior primitives includes the step of analyzing 
temporal ordering of said behavior primitives, such as using information about a 
transition from a previous behavior primitive to a next behavior primitive, and applying all 
applicable conditions and rules. 

20. (currently amended) The method of claim 19, wherein said analvzinp temporal 
ordering of said behavior primitives tompoml analysis is a time-series analysis such as 
Hidden Markov Model (HMM). 

21 . (currently amended) The method of claim 8 +9, wherein ^ said st e p of d e t e rmining 
aotual b e havior inoludoa identifying actual b e havior s e l e ct e d from a group set of 
predetermined behaviors corresponds to a set o f pre-trained behavior models. 

22. (currently amended) The method of claim 8 3+, wherein said group of b e havior 
mod e ls inoludoa flio behavior of set of predetermined behaviors includes rearing up to a fully 
reared up or partially reared up position, and said r e aring behavior which is determined by a 
Ae sequence of postures starting from cuddled, horizontal side-view, or horizontal front/back 
view postures to ending in a vertical or partially reared posturet- 
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23. (currently amended) The method of claim 8 24-, wherein said group of b e havior 
mod e ls includes th e behavior of set of predetermined behaviors includes coming down from a 
reared up or partially reared up position, and said oomo down behavior which is determined 
by a ^ sequence of postures starting from vertical or partially reared postures to ending in a 
cuddled, horizontal side view or horizontal front/back view posturet^ 

24. (currently amended) The method of claim 8 24-, wherein said group of b e havior 
mod e ls includes th e behavior of set of predetermined behaviors includes eating, and said 
eating b e havior which is determined by a sequence of eating postures where the mouth of 
said ^ animal is in touch with a food containert^ 

25. (ciurently amended) The method of claim 8 24-, wherein said group of behavior 
mod e ls includes th e b e havior of set of predetermined behaviors includes drinking, and said 
drinlcing b e havior which is determined by a sequence of drinking postures where the mouth 
of said tiie animal is in touch with a water spoutf. 

26. (currently amended) The method of claim 8 24:, wherein said group of b e havior 
mod e ls includes the behavior of set of predetermined behaviors includes digging, and said 
digging b e havior which is determined by the aft movement of bedding by said die animal 
with its fore and hind limbst^ 

27. (currently amended) The method of claim 8 24-, wherein said group of boha\ior 
mod e ls includ e s th e behavior of set of predetermined behaviors includes foraging, and said 
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foraging b e havior which is determined by the movement of bedding using the mouth and 
forelimbsti 

28. (currently amended) The method of claim 8 2ir, wherein said group of b e havior 
mod e ls includ es the behavior of set of predetermined behaviors includes jumping, and said 
jumping b e havior which is determined by a single up and down movement of said ^ 
animalf. 

29. (currently amended) The method of claim 8 34-, wherein said group of b e havior 
models includ e s th e b e havior of set of predetermined behaviors includes jumping repetitively 
and said r e p e titiv e jumping b e havior . which is determined by several continuous up and 
down movement of said #ie animalf. 

30. (currently amended) The method of claim 8 34-, wherein said group of behavior 
mod e ls inoludos th e b e havior of set of predetermined behaviors includes sniffing, and said 
sniffing behavior which is determined by random brisk movement of the head while the rest 
of the body remains stationaiytt 

3 1 . (currently amended) The method of claim 8 34-, wherein said group of behavior 
mod e ls inoludos the behavior of set of predetermined behaviors includes hanging from the 
top of the cage, and said hanging b e havior which is determined by a sequence of postures 
starting from vertical posture to ending in a hang vertical or hang cuddled posturet^ 
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32. (currently amended) The method of claim 8 24-, wherein said group of b e havior 
mod e ls includes th e behavior of set of predetermined behaviors includes landing after 
hanging, and said landing behavior which is determined by a sequence of postures starting 
from a hang vertical or hang cuddled posture to ending in a vertical posturej^ 

33. (currently amended) The method of claim 8 H-, wherein said group of b e havior 
mod e ls includ e s th e behavior of set of predetermined behaviors includes sleeping, and said 
sle e ping b e havior which is determined by the absence of major movements of the contour of 
said fte animal for a prolonged period of timet. 

34. (currently amended) The method of claim 8 21-, wherein said group of b e havior 
models includes the behavior of set of predetermined behaviors includes twitching during 
sleep, and said twitch b e havior which is determined by detection of a brief period of 
substantial movement and then resumption of sleep activityt. 

35. (currently amended) The method of claim 8 24-, wherein said group of behavior 
mod e ls includ e s th e behavior of set of predetermined behaviors includes awakening from 
sleep, and said awak e n b e havior which is determined by a prolonged movement of said ^ 
animal after sleep has set int. 

36. (currently amended) The method of claim 8 24:, wherein said group of b e havior 
models includes the b e havior of set of predetermined behaviors includes grooming, and said 
grooming behavior which is determined by brisk movement of limbs and mouth in a cyclical 
and periodic pattemt- 
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37. (currently amended) The method of claim 8 34-, wherein said group of behavior 
mod e ls includ e s th e bohavior of set of predetermined behaviors includes pausing briefly, and 
said paus e b e havior which is determined by brief absence of movement of said ^ animalf. 

38. (currently amended) The method of claim 8 34-, wherein said group of behavior 
models includes the behavior of urinating, and said urinate behavior is determined by the 
detection of the tail being raised up and the animal remaining stationary brieflyt. 

39. (currently amended) The method of claim 8 34-, wherein said group of b e havior 
mod e ls includ e s th e b e havior of set of predetermined behaviors includes turning, and said 
tum b e havior which is determined by a sequence of postures starting from horizontal side 
view or cuddled posture to ending in a horizontal front/back view posture, and vice versat^ 

40. (currently amended) The method of claim 8 3t, wherein said group of b e havior 
mod e ls includes th e behavior of set of predetermined behaviors includes circling, and said 
oiroling behavior which is determined by a-J three or more successive tumsj. 

41 . (currently amended) The method of claim 8 34-, wherein said group of behavior 
models includes the bohavior of set of predetermined behaviors includes walking or running, 
and said wallcing or ruiming b e havior which is determined by the continuous sideways 
movement of the centroid of said Ae animalt^ 
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42. (currently amended) The method of claim 8 3+, wherein said group of behavior 
mod e ls inoludos the behavior of set of predetermined behaviors includes body stretching its 
be^ vertically or horizontally, and said stretch b e havior which is determined by a concave 
shape of said #te animal's back^. 

43. (currently amended) The method of claim 8 24-, wherein said group of b e havior 
modols includ e s the behavior of set of predetermined behaviors includes chewing, and said 
ch e wing behavior which is determined by the movement of the mouth while the mouth is not 
in touch with a food containert^ 

44. (currently amended) The method of claim 8 24-, wherein said group of b e havior 
models includes th e behavior of set of predetermined behaviors includes remaining 
stationary, and said stationary b e havior which is determined by said #)e animal remaining in 
the same place and not performing any of the other predetermined behaviorsf. 

45. (currently amended) The method of claim 8 24-, wherein if said set of predetermined 
behaviors includes unknown behavior, which is Ae activity that caimot be characterized by 
any of a set of the behavior models , th e b e havior is d ee m e d unknown; . 

46. (currently amended) The method of claim 8, wherein said steps are else performed in 
night, conditions by using red light to simulate such night conditions, or by using infra-red 
cameras to capture #)e images with no lightf. 
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47. (currently amended) The method of claim 8, wherein said steps are alse performed 
with a plurality of cages or arenas, each of which contains a single animalf^ 

48. (currently amended) The method of claim 8, wherein said step of detecting an animal 
includes the st e p of d etecting body parts of said Ae animalj^ 

49. (currently amended) The method of claim 48, wherein said body parts include the 
headt. 

50. (currently amended) The method of claim 48, wherein said body parts include the 
tailf^ 

51 . (currently amended) The method of claim 48, wherein said body parts include the 
earti 

52. (currently amended) The method of claim 48, wherein said body parts include the 
upper and lower backj. 

53. (currently amended) The method of claim 48, wherein said body parts include the 
abdomen^^ 

54. (currently amended) The method of claim 48, wherein said body parts include the 
hind-limbsti 
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55. (currently amended) The method of claim 48, wherein said body parts include the 
forelimbsj. 
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